🕷️️ Job Radar • SCRAPING

freelancer.com 🟢 2026-05-14

🔹 Restore and Secure Weekly Data Scraping from Password-Protected Website
👤 Client: 🇺🇸 Rancho Cucamonga, United States Member since 2021-02-16
💰 Price: $145 Average bid
🚩 Problem: Automated data scraping stopped due to site detection of the bot.
📦 Existing: [Google Sheet], [Standard username/password login]

Specifications:

[Stack] - Node.js with Puppeteer for headless browser automation, Apps Script for Google Sheets integration, and Cloud Functions for scheduling
[Security] - Secure storage of credentials using environment variables or encrypted secrets in Google Cloud Secrets Manager
[Format] - JSON data parsed from web page to match existing sheet structure
[Method] - Automated login with human-like delays, proxy rotation, and headless Chrome scraping
[UI/UX] - Minimal UI for testing and deployment instructions
[Format] - JSON output stored in Google Sheets

Workflow:

Set up Puppeteer to handle headless Chrome with human-like navigation and delay functions.
Implement proxy rotation using a service like ProxyMesh or similar to avoid IP blocking.
Create an Apps Script function to fetch data from the scraped JSON and append it to the correct tabs/columns in the Google Sheet.
Deploy the Puppeteer script as a Cloud Function with scheduled triggers for weekly execution.
Test the entire workflow by manually triggering the Cloud Function and verifying data in the sheet.